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(57) Abstract 

A continuous stream of fonnatted digital data, such 
as a video segment, audio segment, or infonnation stream, 
appears to be a fixed length segment under certain circum- 
stances, defining a virtual segment within the continuous 
stream which moves forward in time in synchrony with 
the continuous stream. The virtual segment thus defined 
can be explored in a non-linear fashion at arbitrary play- 
back rates. For instance, concepts such as rewind, pause, 
frame advance, and fast forward become meaningful even 
though the continuous stream never ceases. 
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Method And Apparatus Implementing Random Access 
And Time-Based Functions On A Contmuous Stream Of 
Formatted Digital Data 



pAr-KGROUMP IMVgWTION 
TECHNICAL FIELD 

The invention relates to digital signal pracessing. More particularty. the 
rvUrlestoatan^N of — vvh-* provide fcr the pass »»ough« 
^Colimearstreamsol^i—on represented in vanoustom^ats. 

DESCRIPTION OF THE PRIOR ART 

Witl, the advent ot consumer audio and video products lhat employ 
rhisaoateddigtal^gnal pmcessingtechniq^ it is incoming necess^y to 
W ways to exploH me U potential of digital techndogy. For example 
" Z desirabteto provide methods tor the pass trough or^«^ 
r^streams 0. ^ intom««on represented in vadous 
same time providing the appearance to the consumer of a locally stored 
3 m ^ <^ *e reposK^nlng and playbacR of ^ 
segments of the apparently local digital stream. 

A mechanical device which peHomts some of these fundicns te the Video 
C^e Reoorter (VCR). ^ uses a maj»«c tape to store the 

fast fo-wart, pause. However, a VCR oanno. >>o«l o^re a^ 
;,ay back lnlom«ti«. a. the same t^e,soHoannot be used to implements 

capability. 

U„ears.reamsofW.m«tionarea«xture of modem file. C-sider broa*^ 
radio stations, broadcast television staticns, satellte broadcasts, cable 
rision. vid;o tapes, and compact d«<s. Increa^gly, ^ 
represented h a fashk. ^Hable for martpulafion by '"^^^^ 
hLware such as computers or media decoders. For example, the D«a 
V^Broadcast (DVB) standards address d««al b-oad^ng ^ 
satellites, terrestnal stations, and cable television systems. Even analog 
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wo99/52r79 ^ Television Standards 

broadcasts, such as nomial NTSC (N^on 

digital streams. 

provide ,he for «» ^^R-like be 

performed on the ^nd timing of the broadoes. 

^„os, never J^^ "^^ „^ .o <«sclp«ne 

would ia<e to rewind to the point he missed and play « agern. 

^. a dev^e ^ to the viewer should -^I^^^X: 

place, and playbaok,nte,ed».^J^ ^ ^ 

rewind was "^"^*<'- ^^,=^,',,"2^ rewound to the apprapriate 
broadcast stream while the second is halted ana re equipment 
position, Cont^uing «s exerc^, one can ^f^^J^^^^ 



solution. 



» is possible to implement «s capabilHy >m a '^.'^ 
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these issues by providing ateehn^e tor s.onng *e s.«an,s o. Wo^aton 
on a temporary basis. 

When using a digSa. computer to perfom any technk,ue whi* achieves !^ 

r.^rrrecrrir^r.^^^^^^^ 

^ sin,, ea* ^ o. analog data . oonverted toab^ ^ 
^ samples representing .he H me '■^^^J^ 
™„esented each digital block contains approximately 0.5 MB ol data, one 
^r^Jresapproximately 30 MB o, storage, and 30 s«on^ 

requires approximately 900 MB of storage, greater than the 
i;to,T^^^^sc.Manip^a«ono, Video in th^formdearV becornes 

Zl^ wi^en any useful length of stor^ video is contemplated. 

AS an example, consider U.S. patent no. 5,625,46, which concerns thej^ 
0 a miX* « for tl« storage of broadcast te^^^ -^TT; 
^e aniunt of storage available on such media is cunenUy about 5 to 10 
riZl^isslentlorapp^ximately ssecondsofvideo storage^ 

simultaneous recording and playback of the same progrem. 

Umited storage capacity is dealt witb by compressing the video streann using 

^ algcnmms, ^ achieve a useful "^^ " ^.l ^ 
many hstanLs. MPEG video is represented as a sequence of Groups Of 
ZIs (GOPS), H Which each GOP begins with an hdex freme, called the 1- 
^ tST^ is a btock Of d^ data ^a, is compressed 
^e^me Tra^fom, (DOT, a^ other tec^^iques, sWar to the * 
picture Joint Photographic Experts Group (JPEG) standard. 

The GOP may represent up to 15 addffional frames by providing a mu* 

Ta-er^ ^ il data « W^es how ^ 

referred to as macrobtocks, move over time. Thus, MPEG achieves «s 

^C^on by assume « only ^ portions of an e«ge change over 

ZTZ^ me representaf- of these ad<f«k>na. fremes extremely 

compact. 
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^tefn rilves, «» f^mes a GOP have a spe* ««on.^ 

acoount me vartable (and unpredldable) data s^ee mvolved, as well as be 
cognizant of the relatkxiships between blocks of the stream. 

A second issue for a digital computer based implementation of su* -rteth-^s 
t^ulple streams of »^ must be ttandied n pastel For 
L™ie a broadcast stream « actual composed of at leas, two unique 
<X *nT«.ton, /.a. a stream o. digital WocKs representng the vjsu^ 
Ze and a steam of dig«al blocks representing the aud,We ™a^ If^ 
Zto is ««lead stereo, then two audkj streams am eluded, each 
»as, s^ may have ac«^ c^. such as *s Secondary 
Tud o Pmgram (SAP), ^re the stream of Is a 

eudtsl^ to a different language. Another stream whch may be present b 
f Cl^Caption (GO) stream, ^ provides atexmal representatBn of 
l^r^^^ h *e audto s^(s). The simple broadcast st«^ 
n elr may thereto, have at ^ five afferent "-PO-* «^ 
one compressed using different .echnk,ues. When presenting th« cornplex 
to a Viewer, the bkxks of each stream must be decoded * 
I^pnl times for *e compres^on methods — and syn*ron.ed 
with the piBsentaBon of aH other streams. 

Also of Merest are dytal broadcastiig technologies, such as DVB. A DVB 
Zr^ is fomted an MPEG2 Transpoh Multiplex, which rs an encod^g 

Xovides k,r mtedeav^g any number of discrete st^s 
STwom^L mto a single st«am of d^W data, using tech^ques based 
on^n^ Dlvlston Muinplex^g (TDM). the example television s«na. above 
Z be encoded Into a DVB channel using five discrete streams, leav^ 
additional capacity for other streams. 

There » increasing interest k> adding addMonal WomBtion streane to a 
Te^br^dJ^n^. For instance, « may be desirable .0 t«sm. au*o 
several dLrent languages h par* w«h the video stream. Or, 
^llmationthat.interpretedasaweb page 
way as to be synchronized with the video to provide a multrmedra 
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presema^on. number o, s.reams *h be 
Lm„ and each sfean, may be represented usnig dflerenl and un,^ 
S;^e ^compression ted^nK^ ^ have « own s,nd»n^ 
requirements and inter-lrame relationships. 

Any methods ^i.*. provide f«K««.* simi^ «« 
tiiese issues. 

-UWMflPY "F THF imvenTION 

The methods and apparatus desonbed herein implement a novel and uniq^ 
^Tl. provides for me m^lpula«on of a con«nuous stream of d.g« 
^Son L if it supported ^ access and va«le rate P-^-*" °" 
by the consumer of the stream. The possible operators on *e 
are iimKed on^ by me stooge capac^ end 'OJ-^ ^ 
svstem which implements the apparatus and methods, whether that storage 
rraT such as DRAM. « nonvolatile, as hani dfeK stomge or a 
c^r^^ d both. The ap^s and memods support opemt,,^ 
Z«Ls referred to as virtual VCR functk»«. su* as pause, rewind, m 

Hat^ pay and P^V " -erse: Add«on^^. «;e appare^ 
l lmods descrtbed t«,en. provide a me*anfem whereby s^ 
^raLs are Instantar^ous from the point of view of me -^-"^ 
<Lst«am.unykermechanioalsystems. The apparatus and metho^ ateo 
Tport the ability to ca,^re portions of me data stream »e 
TporaH, he« by me apparatus, such ma, m. captured da« ^be sto^d 
or L over a netwo* h formats suitable for presorting me *^ to omer 
cc^sumeis, or for editing and manipulation by other tools or memods. 

The invertlon provides a memod and apparatus for providing pass mmus#i 
Tc^re of L»«ous l»«ar steams of tf^tel mfonnato, ^P'e=^^" 
aiS fonnats wh«e prov«ing me appeara«=e o, a ^ ^J^ 
The preferred embodiment of tt« inven«on compnses a, leas, o^ med^a 
oaohe for copying blocks of data from me WonnatBn stream. Data n me 
^a^*el. bedewed asa snapshot of me a^ntinuous stream of 
:ZZ. The hivention *o compnses a playbacK poirtar. The playbac 
^nterposif^sdectsaportionofmemediacaohematis to be accessed to 
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- . ^ « onw of Dause rewind, fast forward, play, play 
provide functions including any of pause, rewinu, 

faster, play slower, and play in reverse. 

BE!EF_DESGB!ET!QN_QLTi^^ 

Rg. 1 feasd.ematic representation of a <x)ntinuous media buffer accorc^ng to 
the invention; 

F,g. 2 is a block ^ °' = l^"^' * 

me«a buffer according to the Invention; 

F^3,satim^g<r«gram Shoeing the operation o. a »naa, c«he acco*g to 

the invention; 

PPTM. FD DEsrnirrr-i "F ^"^ '""ention 

The mvento contemplates a new and unique appa^tus ^^"^ ^ 
ccrtnuous strean^ o. *«a. *,n«.on u.ng the n«thods and 

techniques described herein. 

F«m 1 provides a general overview of how the prefened embodlmert of 
^n^ ope Js on a con«™.ous ^ream of data. ^ ^1^1^ 
ZZe^ cLs 10 copy btooKs o. ^.a fro. an '^^J^ 
The poswon of a playback pointer 14 selects a port»n of the "»<'^<^ 
^ ^ZZ accused, thus allowing such fun<Jk>ns as pause, rew«d, f^ 
l^d a^ p:::rwe« as ntore soph^cated a^ unique operations, ^ 
as play faster, play stower, and play in reverse. 

apparatus b Independent of the fonnat of the undedyhg *gBl ^ 
I^LTCapply the inventton, i is only necessao- that the undertyng data 
Z: JZosed Of a number of discrete ...^ of p o"^ 
c™.. of atHibules aie associated with each block The data blocks 
Csetes nT^ 0, a^Hrary s.e and forrnaf. K is assun^d « p™^^^^^^^ 
s^aHzed to a data source or to a decoding operation may proceed ree^ 
:rdtex. of the ^ventlon, M^V cor^rCed by the methods 
described herein. 

Figu. 2 ^^trates the prefened embodiment o, ^ i— W* the 
example h Figure 2 is provided h connec«on w* an MPEG stmam 
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TZn, « Should be app^atei « .ven«on . .eadlly ap^^ .» 
any digital stream of information. 

Ma„,u^l».BndU.ns.or™«ono.ada,as«a™ispe*™edh,he^ve„«on 
by a combination of the following elements; 

, The Buffer ConfmHe, (201) is the m^n n^anagement devioajt 

control messagesfor the other devices olthe invention; 

2 The Stream Clock (202) provides ageneral device for ^na^ 

that they present their data at consistent delivery rates; 

, The Unear Cache (204) fe a general device for buff«^ 



and 
4 



A The Clio Capture (203) device is a general mechanism for capturing al 
o;partlSrhSofHoL- 

orgaLd stream of data to a data .nk ^ as. for example, a 
computer file system or another display device. 

Thefbllowingsections describe ead. of the foregoing components, and how 
they interact, in detail. 

BUFFER CONTROLLER 

The Buffer Controller (BC) module is responsible for instantiating the 

sti z^or more Clip Capture (CC) modules, ^ one or more 

:\.C, n»d^--p-. 0. the..*npr.^^^^ 

c des^atng c«e of the LC str^s ^ ^ ^ 

rr r r s rr p^-: r s^eam .» pos,. . ^ 
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rBC^^«ons^,<.mers.«an..obesynchrooizedwHh*eKeysWan,. 

The BC is .so respons«.,e .or M ^ "^t*! SC^e.'^ 
which operates as deschbed below. The rate a. wh«*^ the ^^^^^ 
. !^m.llnMrCacheslsbasedontheiato specified by IheBC. THUS, 

He rTs^rupl; Slow down the playbao. o, the en«re ^ o. 

streams by requesting the SC to adjust its dock rate. 

the BC s responsible for Ma«ng dip capture operations r^ng the 
Clip Capture method. 

STREAM CLOCK 

Cfo* distributes events to ea* LC at the proper rate for that LC. 

Stream Clod^usesasingle queue for managing events JO be dls«tn«ed 
Zsanda,.,p.fora«te*nK^,estha.aiB ,an*r.o those sloW .the anof 
building time-based software systems, 
operation of the Stream Clock Is detailed below. 

Events are not queued wNh an absolute time, but w* the reMve offset fmm 
r^liously queued event. The m event h the queue « marked wrth a 
S^'^Th leoffsetfK^itthecurmnttlme. The Stream Ck>d< ^ reques^ 
r^unde^y^ ope^rrg system invoke a c^ o. ^iZZlt 
^e^ passed, ., the SC queu^—^^^ 
invoked the SC d spatches the first ciock eveni <«iu u „ 
::TJL Offset is ze., /.e. e^ even, that Is to occur at the same .me as 
the previous event. 



PCTAJS99/D4W1 
WO 99/52279 g 

th s event should be repeaiea. rfratpav insures that 

even if some delay occurs m d'spateh."g processed. 

which the above process repeats. 

The decoupling o. the absolute clock value and the actual "i^*^ »' ** 

::r oL^ . .^^^^ — r rr^ : r 

invention, e.g. the ability o ^ J' ^^,^^3 referred to as 

results in a slower playback of the stream, 

Fc the LCs to position themselves properly (see '^'^'^'^^l ^^ * 

burrpr.rsr.c=^^^^^^^ 

stored in the SC. 

— rr:;r:r.^;ter:^ 

common time*ased softvvare design technu,ues. 
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THE LINEAR CACHE 

A key component o. me ^n«on is «,e Unear Cache (LC). ^^^^^^^ 
I /cinnie stream of diollal irtomation in proper sequence. Hie LC 

ma*ed wim a P»sen««on Time Stamp (PTS) <^ ^ 
block should be preserved to Ihe decoding process, be . 

CTo, PTS . an«»«.on^:. ^^'^i^, 

naroware □ ^ ^ ^ not related to 

rrrps'djreX^ ^ zzrr 

e>«ept that once the LC begins operation, there ,s a constant offset between 
^TtS stored h the LC ar^ any «me stamps stored w«hn ^ encode^ 
*iB^blocks It is assumed that the decoding process properly bodies 
*r^me stamps. Figure 3 gives a pc^l overview o, me preferred 
embodiment of the Linear Cache. 

Tbe capture mechanism for a particuto stream type gives ^ «^ 
Z.tcK to «,e LC as « ar^es <30„. The LC '^'^^ ^J^^ 

*x me ^. The LC :,:::':^rn wr^e 

defined as the rrraximum time, based on PTS values, d«w 

n^ block in me LC amved and me oldest «cck wh* me LC mayh*. 

Ute wirKtow represents a time span Wo the past h«.,y of me s^^ 
Te LC di bloLv^teh fall outage me window (303), mus me window 
^oTtc kx* a fixed distance rto the past t«to.y of a stream. This 
tZZ \>>^ *o^ and uadeoffs between available storage space 
and me availability of past infomiation for viewing. 

Tbe capture mechan-ism lesponsibie for providing certain attributes al^ 
I Zr^ ^ (304). The m Of mese . the key 
»^ ^ MS block begins a sequence of 'n*-=^ 
eertomting random access operatk>ns on a stream, me LC 
Z^ingofmestream.oablcckmartedasaKeyframe.Tf,ese»ndj^ 

S^f segment (EOS) attribute, v** indues tf^t the ^^"^^ 
and no more data am to be presented. For example, '"'^ 
^EG GOP is mart<ed as a key frame by me capture mechanism, but a. 
Other blocks are not so marked. 
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decoding process, «hioh is referred to as the currwJ block ndcator (305^ Fo^ 
^X„g, b the .-0* ^ added to ^ LC by t^ «P^re 

r^ar-sm. Is, the stream presents' ""^'^ 
delay between capture and presentation. 

ReMom access to the Wormalion stream Is achieved by nnoving the current 

Sl^osonteotherbtocklntheLC. »,heLC 

lherdk!ator,and the cunentblock indicated is notakeyframe, the LC «s»u* 

ZZo^9 process to reset «s decoding state, pu^N any pa^^ 
Is^pLntaton data. For example, „he client frame, an MPEG 
fie («, then the decoding process has state ,nfom,«»n 
irl^udlngthecurrentptetu^toben^fiedbythe P-fr^me. data must be 
purged so that the decoder begins in the proper stale. 

Refernng agat. to Figure 2, the BC '-^"^ 
specifying a PTS value. The LC «nds the block contam^ a PTS whch b 
c" ^at «,uested by the BC. There are t»o unK^e cases for 
the .1^ « the LC . ma^ed as the key stream, and ^ sec»,d 

when it is not. 

,f the LC is marked as a key strBam. the LC scans the blocks h the cadie to 
iimen-ioiirai , .J ,„ ,u» roni lasted PTS va^ue, searching 

llnd the key frame which is nearest to the requested f i s va ■ « 
both befo,^ and after the desired value. Once properly pos,t,or«d the LC 
returns to the BC the FTS of the key frame block which was identified. 

Following posittoning of the key stream, the BC instmcts each rema»,g 
slroam to ^sWon Itself to the FTS returned by the key^am. Key f«mes n 
^r LCs may net ai^. v* those ii *e key s^. Each LC hand^ 
problem by requesSng the decoding process to purge any decoding sBte 
anTthen Jan ^dteation that supf^esses the LC from a*«Hr presenting 
blocks to the decoding process. 

Foltowlng Ihte, the LC behaves nomtaly, accepting dock events and 
the cur^nt block ^icfeator to n..*, except that me blocks are no. 
iSvP^sentedto decoding process. When the LC encoume. a ^ 
Le « deletes the ind«a.ion suppressing presentation of btocks. and 
^ fhe cunen. block to the decoding process. This brings the stream 
into full synchronization with the key stream. 
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^ mmn, subse*ns describe T detail how pos«on^ operaf^ns a« 
handled by Ihe LC. 

Forward 

^ fo^an. *,™*on Is implen,en.ed by moving me ounen. ^^'^ 
Tl „h cache bv one block for each event generated by the 

rr^rjrr^jrre^^^^^^ 

rrrc^ r^rasCbiocksareaddeatotheLC b, thecap^ra 
;^^'C;.a,,,thecu,...biocKW^p.nts..esan^^^^ 
i, the cache while the window of cached blocks moves beneath t Fn=m (he 
;tpeTe'^ me c^sum. of a st^am, this resuHs . play o- a. a .«ed 

delay from real time. 

Thora exists a «le at which the decoding pracess may not be able to 
^n!?rw>i to the consumer before decoding of the next block must 
bXe T^'^ not keep up w»h the playback «e requited. 
S LC ie^s * c^, ^ reve^ to a key frame based n,^^ 
Ter^Lmtlte blocks are skipped and only key frBmes a« presented to 
the decoder. 

ounent block intfcak^ can not be positioned to an uncached blo*Jf»» 

ZJ> moves ,0 the from of cache. ,n th. 
•rtfcates to the BC that no more blocks are present n the cache. The BO 
^me SC «.e mulSplier to one, «l LC pos»k,ns me ^ 
I^to me west ca^ed block. The eHect of ^ operation « to reven to 
undelayed play out of me actual infomiatfon stream. 

Reverse 

reverse fur^ti^ implemented by moving me 
;2<Ldsmmughmecad«by»«blodkforeachck>ck event 9ene^«' 
S^Tlaain me key stream LC is used to control postoning. The BC 
^ LC to move to reverse mode, h which me cunen. bk«k 
S^rr^o!^ IZ^ one block on ea* event. In ad«o„, «s 
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d«oding process. When me omen, block nd^ator « moved over a key 
tame, the btock is preser>ted to the decoding process. 

■n,e rate at vrtch blocks e» presented to the decoding process te contr^led 
ry r^,eC«pl^ ^ Stream Clock, a,^ tor a,b«y speed o, 

reverse operation. 

as descnbed above. The key tra^ ^ 

ft appears as the stream began playir^g n a fon^a,. d.recton 
again, time delayed by the window size. 

Pause 

The BC implements the pause function by locking the current block indicator 'n 
The BC implements in p ^ .^^.^^^^ ^ 

rr b.r: iri'or su. a .o. ..e^.^ key 
block, ™^ w a lock has been requested. 

r^r^^. ancTlocksthe bicck Mcatcr » « key^ 
l^C^T«sents » key frame to the decoding process, ^ W 
Z^^Xm. me decoding process point "f;-^"^^, 
FoL^ tt* as new blocks are added to me fton. o me ca*^ me btack 
wLed moves backwards h me cache. AddWonally, me LC sets me 
::S?suppressingfunherpresen,at»o.datatomedecod,ng process. 

For each non^ey^tream LO, me BC simply suppresses further preserWon 
rdl b^ to me decoding process. ^ BC -V ^ '^^-"^^^ 

release me pause (/.e. to play me stream). In m,s case, me BC obtains the 

^^r<:„entb^(es modiW by me SC rate 

„„am LC, ^ erects e»^ — LC to pos^ ^pro^«^ =^ 

described above. It men releases the to* on each LC, resuH^g 
presentation of bkjcks to the decoding processes. 
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» is oossibte thai the window movLt past the block to wh* the rticator 6 
L^c^uroapture Of the incoming st^ann is <»*uous. 
'^S^,oo^a,^mele«p™n«n9a.t.« ea.es, blocic*, .he ca*.!^ 
indicatwisun ^ p^^^^ smilar to the 

- --^^'^^ 

the tape and playback heads. 
Get Clip 

Thtefa™«<>.isused»e«mcta.angeo,blccKs*on,thecache.-[he«amtwo 
,«,des in which « operates: .elaUve mode and absolute mode. 

AS discussed above, the ca*ed b^Ks appear as 

» «,Hor The QtetdiDO function returns a pointer to a cached diock. 
^rr::™::i!cKs,hatmaKeup,he«nge. «^ 
JLa «, as a dip For efSciency sake, the pointer returned directly 
L^a ^ and Ute ..io^n, biocks are re,.eved by ^ 
r, n=« block t* r each-cached block. TTiis Sst is only valid rf the fksl block 
^i:::rjr;:uccee*g blocks «ma. ca^ed c*r has 

completed its operation on the clip. 

The LC has following behavior to avoid ^da«ng ^ 
„. , rtin- the oetdlDO funcBon sets an indkator n the LC that suppresses 
l^Igb^llf^l outside window. TNs Wk^or is dea^ whan 
r^edM fund^ is ce^ed. The releasedW ^ also tnms the 
cache to the window size. 

Tv,o of this sequence is that the number of blocks m the LC may 
Z^,:cleTs.he^^nsi«l«yo,.hec.lero,.ege,c,ipO^ 

To <S»rate «, the dip as rapidly as possible because s^cmge ^a» tK 
^ed bkx*s is a IWed resource. However, this strategy allows a d^«> b e 
^^IwKhoutlnteHeHngwHh me ongok,g payback »' 
^ avoids presenting the consumer oftheblodcswtthanyatUadsofthe 

capture operation. 

,n relative mode, the clip to be Cptured is speoKied as h«o '^■^ 
^esentng an offset fram the cunent blod< Mfcalor * previous btocte r 
ZZT^ me second rep^senting ^ offset from me a™. blod< 
;:::mbse<,uen, blod<s h me cad^. The offset . both cases . 
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exoressed as a time deferential from the PTS stored ^ the current Wock. ^ 
J^^acalre operation might occur fromfive secor^ds before the 
S^ro\rnnds after ^e current blocK. No u^ched biocks may ^ 
irl^ldby^agetdipOoperation. Thus, the LC trims the actual cl.p .turr^ed 
to match the blocks available in the cache. 

^ absolute mods, ^ * .o be o.^^ ^ sp^ffied » -"^ "^^^^^^ 
^ «Dtesentino an absolute time stamp based on when the LC began 
secor. repres^nng a time <^<^^^;^^ 
he a neoath/e offset On*ating a distance backwards n the ca*e) or a 
'Zt l^^ca^ dis.«=e towards n ma cac.«). ^e c^ . <^ 
above and trimmed as necessa^. TOs also "npl»s ttel 
Z^Z^'^^^ o' « no bio* . me <^e . w^t. .he 
time window described. 

CLIP CAPTURE 

The Clip capture module is responsible for selecting ranges of blocks from a 
t n LOS brinqing them together into an appropriate storage or 

:^^s:is^n\r:^s^^^^^ 

blocks from multiple LCs also referred to as a cl.p. The Cl.p Capture 
operation is invoked by the BO on external request. 

There are two ways in which this request may be made: 

First the BC may indicate that capture should occur based on the current 
"iSclndi^L in L key stream LC. which . referred to as a re.at.e capture, 
in which case a relative range of capture is specified. 

second the BC may indicate an absolute range, h which case only blocks 
rZl-m a PTS inclus^e . ^ range are captured. Ihis . referred to as 
an absolute capture. 

•me operation of the Clip Capture module is straig«fon«ard. For each LC>e 
Z calls the getCipO ^ of tl^t LC w«h P--^-^"^^^ 
bv the BC Ttte Clip Capture module then linearizes the blocks into a 
ICL.!^ stream a,^* -or the flna, clip fon.at desired^ F« examp^ 
senerate » MPEG System Stream, intedea*g btocks from the 
various LCs as needed. 
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Thfe irtedeavinfl is oonceplually simple. Hie CC ioops through each dip 
^ ■ »n choo^ng the block wHh the eartiest PTS from among el 

Z^^'^TZprc^e. ana a<.^ the hic* poi«.r ^ 
t7*,otheLblcck.VVhen^ltheblool<sfroma«dipsareexhauste4 

Ip^roperauon Is complete. The CC then loops thmugh a. LCs c*g the 

releaseclipO function. 

AKhough the '^ntton is descnbed her«n ««h refemnce » 
T:i„.„. »ne skilled n the art wi» readily appreciate that other 
:Xon mrbet luted .or those set he* vvitho^ departing 
T^Z, scope 0. ^e present InvenSoo. Accordingly, the «^ 
should only be limHed by the Claims included below. 
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CLAIMS 

^ othnH for oroviding pass through or capture of continuous Bnear 
L JoC ^^r^. . va.ous fo^ats while providing 
u InL of a locally stored stream, comprising the steps of. 
""'^'TZZ::^^^^^ -ciia cace for copying blocKs of data ^ 
3.dinfolLLam.whereindatainsaidmed.^ 

plurality of discrete blocks of data. 

, Tiw method of aaiml, further comprising the step of: 

Z*g a buffer controller «rat adepts external requeeU <^ 
^j:lZ6 infon^^on stream and . 9enera.es appropnate 

"""'"J^lTbuffer co^Cer .sta^ates methods that^^de for 
^ operatico ^ co^^ - any partk^lar stream of n.orma.K.n. 

"-idrsT^rertzt :::: : 

^mXe 1- 0, data present «r data a. c««lste,« del.ery rates. 

wherein said stream olocK prevides a «n«al synchrontotion fad«y mat 
distributes tme based events to a number of media caches. 
4 The method of Claim 3, further comprising the step of: 
■ designating one of said multiple streams as a key strearii; 

Sem alU^ng of payback from ™dia oe.^^^^ 
m positk>nin, saw key sBeam, and «.en using a W positron o, that stream 
to position all other streams properly; 

wherehi posHlonhrg based on alignhg a amert block 
beglr^^ of an MPEG Gmup Of Pictures when sa« ke, stream « an MPEG 
video stream; and 
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v*ere*, a buffer contn>lle,'*reposittons a« other streams to be 
synehronned with sakJ f<ey stream or«e said key stream is |»s.toned. 

5 The method of Claim 3. further comprising the step of: 

providing a buffer oontrt-ler thai « responsible for controlling a <*x* 

rate of said stream clock; . . 

whe«n the rate at which said stream clock deit^rs ckx* evente to said 
n«dia cache isbasedonaratespedfted by said buffercomrCler; and 

Wherein seidbuffercontr^terc^ speed "^''^^^^ 
^ ertm c»tec*cn of streams by requesting saki stream deck to ad,us. ns 

dock rate. 

6. Ihe method of Claim 3, wherein events are queued with a relative 
offset from a previously queued event; j..^ ^ 

Wherein a firs. even, h said queue is marked wim a «e v«, « an 

offset from a current time; 

^rem said stream dcd< requests that underf^ng opera^ng 
svstem invoke a call out when mat amount of time has passed; and 
^Iram saki stream dispatches a ^ cto* even, and *en each 
succeeding even, whose offset is zero when sakJ call ou. is invoked. 

7 The method of Claim 1, wherein saki media cache maintains said 
siream as a « of .he tf*al blocks M make up sak) sWam, and assumes 
*a. each Meek in saM stream has a unique size and asnbutes; 

^ said aflnbu.es l^ude any of a key tane annbute »h* 
Wlca.es M s^d bio* begins a sequence of ,n.er-«la.ed blocks su* M 
saklmediacacheonly^kMsposHioning of ^^'"^"^^^ 
akey frame when perfomring mndom access operafions on sari s.ra^, and 
an End Of Segmen. (EOS) aWbu.e vM. mdteates the. sa«J stream has 
ended and that no more data ai« to be presented; 

Wherein ea* btoc* wSht, said aream mark^J V* a Presematon 

Time samp (FTS) which indicates when .ha. block shoukl be presemed to a 

*°"*XrSd PTS is a monotonically increasing value kiitialized tojro 
when sak) media cache first begins operate on a stteam and is not rebted to 
any time sBmps defined by an underlying sliaam enco*ng .e*™qu^ 
ex^piwrnere isaconsartoffse. between saki PTS stoTBd n sard n^ 

ca*e and any time s.amps stored within said encoded ds«al btooks once 

said media cache begins operation; 
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Wherein a caplurt mechanJn'for a patobr stmam type gives «rt 
Z .0 said .edia oad» as . anives and prov,dea ce« 

^"ir ^dCrd?™- said encoded d^ .ooK a 
"^2Z r ^ns a Window v.. . — 

llTsutLtid^dow .p^n. a «n^span i* a pas. h.o. c, s^ 

"""'wherein sakJ media oache ntf ntains ^ indtea«on of a next Wo* to be 
nrasented to a decoding process; and ^^k« 
' Irein said next i^lock a IMook test added .0 sak. med« eache by 
«id caplure mechanism, su* .ha, said stream is presented live a, most a 
one-frame time delay between capture and presentation. 

8 The method of Claim 7, wherein random access to said stream is 
achtevrby movK^ a cuner. block to ano^ btocK . sa^ med« 

"^■'tl^erein said media ca<*« »^ a decoding process » re^ ^ 
*oo<«ng «.te, «,us purgi^ any pa.^^ constrected P--^^-^ 
media <ihe requested to move said block «*cator, and a c«ren, bkx* 
indicated is not a key frame. 

9 The method of Claim 7, further comprtsing the step of; 

providing a buffer conlMler that requests repos*oning of a media 

l^I'lTlTscans blocks of data n sa« med. to 
W a ^ ^ -res. to a requested PTS v^ue, e^ bo^^ 

b^ore and afler a desired value, » said medta ca*e B "^^J^J"^ 
^ ^ereL said media returns PTS of sa« key fmme block 

to sak. buffer c«*ol^. o^ sa« media ca*e « property 

'""'"^geadtrem^nlngs.eam.opos.^ itself to said PTS re^njed 
hy saidC Jam, wherein key frames . o*er n«.a caches may nc^^n 
111 Jb, said key s»eam, r v*,* even, each media cache requ^a 
Z*g process to purge any decoding state, »td then stores an nd^n 
Tstp^resses ^ «her media cad. «om a<*«lV presenting b^ to 
said decoding process; 
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Wherein said media cache a,Spts clock events and advances a cuna. 
block indicatortomatch, except lhat said btocks are not actually presented to 

said decoding process; . ,ui i.^. 

deleting an indication suppressing presentation of blocks, and 
presenting a curent block to said decoding process when said media 

cache encounters a key frame. 

10 The method of Claim 1, wherein a fon^ard/reverse function fe 
implemented by moving a current block indicator fon^ard/reverse through sa.d 
media cache by one block for each event generated by a stream clock; 

wherein each successive block in said media cache .s given to an 
optional decoding process for presentation as dock events are dispatched 

bv said stream clock; 

wherein a rate multiplier causes a current block hdicator to move 
fon^ard/reverse Wrthin said media cache at a selected .ate as new blocks are 
added to said media cache by a capture process, resulting in play out at a 
fixed delay from real time; 

wherein said media cache reverts to a key frame based method n 
which intem^ediate blocks are skipped and only key fremes are presented to 
said decoder if said decoder can not keep up wrth a playback rate requested; 

wherein a buffer controller resets said stream dock rate multiplier to 
one. and ead, media cad^ positions a current block indicator to a latest 
cadied block if said current block indicator moves to a frent of said media 
cache where no more blocks are present in said media cache; 

wherein said current block indicator is set to an earliest block m said 
media cadie rf a dod< event would result h moving a cunent blod< indicator 
past said earliest block; and 

wherein play out thereafter continues and that it appears as rf said 
stream is playing in a forward direction again. 

1 1 The method of Claim 1 , further comprising the step of: 

providing a buffer controller for implementing a pause function by 

loddng a current blod< indicator h a key stream media cadne to a key frame 

block nearest a currently indicated block; 

searching fonward for said key frame block in said media cadie if said 

current block is not a key frame block; 

storing an indication that a lod< has been requested if no key frame is 

present; 
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"'"T*.^ ^ cun^n ^ &a>or .0 a .ey Ira™ when a 0^ 
^'^r:^='^--an.e«po«.a..e.^^^ 

said media »*e i. a «-eam window moves p«. » » ^ 
indicaw is locked, ».emby providing aulomatK= release of said pause. 

,2 The method of Claim 1 , further comprising ^ 

v,«hh said eicnadton which fall outside a w»«fow. 

,1 •niemethodofClaiml.furthercompiisinglhestopof: 

Z^clip capture module for seleoSng ranges of blocks a 

se. Of :ltLs, b Jng said together Into an app^te forage 

"t^nsm^toh .om«., sav^g or seeing s^ *f ^ "^^tx.r 
«he.,i„ a buffer controlle. indicates whom a ca,*ire shcukJ cccu 

based on a cunent t>lcck indtetor in a key stream media cache. 

,1 An apparatus for providing pass through or capture of continuous hear 
lilean^ ofT^nfon^on represented . vah-s fom^ts while proving 

:::trrrc:pr:ocks of da. ^ 

«, JLttream, wherein data . saki med^ cache can be viewed as a 
™,>*ni of sakf continuous stream of digital inforniaton; 
^a ICn^Wer, whereh a playback pointer pos«ion seleas a 

plurality of (Sscrete blocks of data. 

IS TheaooaiatusofClaimU.furthercomprising: 

r^T^olermataccepts extern^ requests for operations on said 
*mJ^ ^ M. - generates appropHate contr. messages: 

where*, s^d buHer contrdter instantiates methods that provide lor 
^ operation connectton »^th any particular stream of infomiatron. 
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16 THe apparatus of Claim 14. further coraprising: 

r3 dock for synchror^feing operations on s^d more than one 

disuibutts time basad events to a number of media caches. 

17 The apparatus of Claim 1 6, furtiwr comprising: . 

aLl for designating one of sa« mult,=te streams as a l«y stream 
lCra«posi«oningof^ayt>adKf,omeachmediacache » ba^don 

nrs. post^rng saS .ey stream, and then u.ng a .nat po«on of ma. stream 

rp::-r:rrL a <^ ^oc. .^^^^^^^^ 

,«ginning of an MPEG Group Of PMures wi,en said key st«am ,s an MPEG 

'^tZinT buffer con»..r reposKions a, other strea^ to be 
synchmnized with sad key stream once said key stream is pos««x.ed. 

IB -iheaDOaratusofClaimie.furthercomprising: 

r^cld^.«.fe-ponsibie.orc»n**gad=d<.a.eofsa«> 

*°"r^theretea.«htehsa.st.amc^d^«e.ckckeve*tosa« 

. en«ro2^ 0. «.ams by re,ues«ng sak. s»e^ do* to ad^rs. ^ 

dock rate. 

19 The apparatus of Ci^m 16, wherein events are queued with a retative 
"•^r^rrverireue is ma^ a - - is a, 
'^"ZZn^ -ests « . unde^g oper.,ng 

--rn's^'rmrrrrrern;^-- 

««»««ng event whose offset is zero when saki call out « «oked. 
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20 The apparatus of Claim 14,'^he,ein said media cache ma^r^ns 
IJ^. Z o, the dig^a. btocKs « make up said s«an,, and assumes 
ma.eachblock-.nsaldstreamhasauniquesizeandatlnWes; 

therein said amibutes include any of a key frame «tnbute »hj* 
sak. b,c«k begins a sequence 0, .,er-«,a.ed 

said media cache only allows posWoning o. sa,d sl«am to a •** -^""J^ 
a key frame when pertomiing random aa^ess operations on saKi stream, and 
„ EnT^ segment (EOS) a«*ute which ind.=a.es tl«. sad straam has 
ended and that no more data are to be presented; 

whereh ea* Mock w*in s^d straam Is mart<ed a Prase,^ 
Tnhe Stamp (PTS) which Wteates when that block should be presented to a 

PTS is a monoton-^a-y ^ v^- to »™ 

^ saki media cache «rsl begins operaUon on a stream and is not related to 
Z^Z stamps defined by a, undert^ng stream encoding te^niqu^ 
«Lt that there is a constant offset between said PTS stored n sard media 
^"^^any time s«n,ps sto^ said encoded CgW b,od<s once 
said media cache begins operation; «K,^e ~,-h 

v^erein a capture mechanism for a particubr stream type gives 
encoded digrtal block to said media cache as ft arrives and provides certa^ 
attributes along with each new block; . , ^, ^ ..^ « 

wherein said media cache marks said encoded digrtal block wrth a 

ri irrent PTS for said Stream; 

wherein said media cache maintains a window which is the maximum 
time, based on PTS values, between the time when a newest block ^ sard 
n cad^e has arrived and ^ oldest block ^ich said -e^- - 
hold, such that said window represents a time-span into a past history of said 

''"""^'wherBin said media cache maintains an indication of a next block to b e 
presented to a decoding process; and 

wherein said next block is a block last added to said media cache by 
said capture mechanism, such that said stream is presented live with at most a 
one-frame time delay between capture and presentation. 

21 The apparatus of Claim 20, wherein random access to said stream is 
achieved by moving a current block indicator to another block h said media 

"^^'tllrein said media cache instmcts a decoding process to reset ite 
decoding state, thus purging any partially constmcted presentation data, rf said 
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^ia requested .c movrsaid blocK and e o,.^ bio* 

indioaJed is not a l<ey Irame. 

22 The apparatus ot Claim 20, further comprising: 

; buffer «.n*.«er mat requests reposiUoning of a med« cadre by 

,^ sc^ biocKs 0, data n s.d rr^. «^ .» 
a kev Ze .vhioh is neamst to a requested PTS value, sea^ltrng both 
X^T.r a de.^ v.ue, « s.d media^ . ^-d -J- 

-terrrre^rrrmedi:- . proper, 
■"^rluie for ea* rem^n.g stream to posi«on «se« to^ 

::rri=r:e;:r,=:n=^ 

bk^Ki^crtomatdr, except « s^d blocks are not a*.*, presented to 
^'^^.^anind^t»nsuppres.^p.ese„.at»no...ocks: 

arr^uleforpresentingacun^ntNocktosaiddecodingprx^esswhen 
sak) media cache encounters a key frame. 

23 The apparatus of Claim 14, wherein a forward/raverse luncfan 
Lp^rZmovingacurrentbk^indicator— ^m-^ 
media cache by one block for each event generated by a stream dock, 

^^L* sucoes^ve ..ock . said medta cache is g«en » a^ 
op^^ decoding process k. presentation as ^ events ara drspatched 

'"^::it^e mump^er causes a cu,^ bio* -^Z 
fon»arlve,se withk, said med« cadre at a selected rate as new tio^^ 
!Zd ,0 sak. media cad. by a captu. process, rasu«.g n play out a. a 

t:r;r ^ •<> ^ 

,*ich iLm«dia.e blocte are skipped and only key frames ara presen.«J to 
«ifde* er « said decoder can not keep up v.Hh a playback rate requested. 
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wherein a buffer controller resets said stream dock rate multiplier to 
one. and ea* media cad^ positions a ^^nt block hdicator to a late^ 
cadged block if said current block indicator moves to a front of sard media 
cadie where no more blod^s are present in said media cadie; 

wherein said current blod. indicator is set to an eadiest block m said 
media cadie rf a dod< event would result h moving a current block ind«:ator 
past said earliest block; and 

wherein play out thereafter continues and that it appears as if said 

stream is playing in a forward direction again. 

24 The apparatus of Claim 14, further comprising: 

a buffer controller for implementing a pause fundion by lodong a 
current block indteator ni a key stream media cadie to a key frame block 
nearest a cuaently indicated block; ^^m<. 

a module for searching fonward for said key frame block m said media 
cache if said current block is not a key frame block; 

a module for storing an indication that a lod< has been requested if no 

key frame is present; . x__ k«„ « 

a module for loddng said current block indicator to a key frame when a 

capture process presents a key frame; and 

wherein said indicator is unlocked and left pointing at an earliest block n 
said media cadie If a stream window moves past a block to whteh said 
indicator is lodged, thereby providing automatic release of said pause. 

25 The apparatus of Claim 14, further comprising: 

a module for extrading a range of blocks from said media cadie n 
erther of a relative mode and an absolute mode by returning a pointer to a 
cadied block plus a count of the number of blocks that make up an extrad 

^Idicator m said media cadie that suppresses discarding blocks 
within said extraction which fall outside a window. 

26 The apparatus of Claim 14, further comprising: 

a dip capture module for selecting ranges of blod<s from a set of 
media cadies. bringing sdd blocks together into an appropriate storage or 
transmission fomiat. and saving or sending said blocks as needed; and 

wherein a buffer controller indicates where a capture should occur 
based on a current block indicator in a key stream media cadie. 
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